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ABSTRACT 

This report, based on a survey completed by testing directors 
in states that are members of the Southern Regional Education Board (SREB), 
describes the status of online testing in SREB states. Overall, SREB states 
are paying limited attention to online testing. Only Virginia is moving 
systematically to implement online testing. By spring 2004, all Virginia high 
schools must be able to use online testing. Several SREB states, including 
Delaware and Kentucky, are conducting pilot tests to study the potential of 
online testing, Texas has one online assessment, algebra. Mississippi uses 
some online, testing for students who need to make up examinations, and 
Maryland and North Carolina are using computerized adaptive testing that is 
designed to meet the needs of disabled students. Some states outside the SREB 
region are addressing online testing, with Idaho, Indiana, and Oregon leading 
in this effort. The experience of Virginia shows steady progress toward the 
goal of having all students able to take the state's Standards of Learning 
tests online by spring 2004. A summary of state responses to questions about 
online testing is included. (SLD) 
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Status of Online Testing 
in the SREB States 



Most educational leaders agree that the idea of replacing paper-and-pencil accountability tests 
with online tests holds considerable promise. Even so, only a few SREB states and other states 
nationally are developing programs to use online testing. What is the potential value of online 
testing? Why are states reluctant to pursue its use more aggressively? States need to consider 
these questions as they look to improve the ways they measure students' academic success. 



What is the potential value of online testing in replacing 
pencil-and'paper high-stakes tests and accountability assessments? 



Online testing offers several benefits: 

■ Rapid reporting to schools — One major disadvantage to pencil- and- paper testing is the 
time required to process the results and report them to schools. Decision-makers need 
to know the results of high-stakes tests quickly. Online testing offers results substantially 
faster than does the traditional testing method. 

■ Ease of use by students — Students are accustomed to using computers for many purposes. 
Several states have found that students prefer taking online tests rather than filling in 
circles on papers. Students say the online tests are more “user-friendly." 

■ Improvements in the state and local management of the testing program — It is time-con- 
suming and laborious to monitor, distribute, collect and store large volumes of pencil-and- 
paper tests. Once in place, an online testing program eliminates many of these logistical 
issues. 

■ Improvements in test security through encryption and other procedures — Carefully 
planned online testing can be far more secure than traditional testing. 

■ Alternative forms of tests for disabled students and other student populations — Online 
testing can improve the way that disabled students receive and respond to test questions. 
Online testing also can be modified to meet the needs of English as a Second Language 
students and students with unique test-taking needs. 

■ Potential cost savings after the first few years — Printing, distributing and managing 
large quantities of tests are expensive. Online testing eliminates much of these costs, but 
installing and managing an online testing program also are costly. There has been too 
little experience with online testing to determine its initial and ongoing costs. 




3 



Why are states reluctant to use online testing as part of their accountability systems^ 



There often is no single answer to this question. States cite several concerns: 

Hi Lack of information about how online testing works and what it takes to make it succeed — 
While some states are planning or pilot-testing programs, no state has used online testing 
long enough to serve as a model. 

■ The apparent complexity of online testing — Successful online testing requires a coordi- 
nated effort by personnel who work with testing, technical and training support, and 
management. 

■ Security and confidentiality — Security is not a problem if states work closely with testing 
and technical organizations. 

■ Cost — There are significant costs involved in implementing online testing systems and 
maintaining them in the early years. 

■ Technology's ability to deliver testing successfully — Several states, including Virginia, have 
shown that well-planned and well-implemented technology is more than adequate to pro- 
vide online testing successfully. 

Q Test questions must be multiple'choice or single-response (including true-and false) questions 
— While it is true that online tests are limited to these types of questions, most high-stakes 
tests focus on such questions anyway. 



What is the status of online testing? 



SREB states are paying limited attention to online testing. One SREB state, Virginia, is 
moving systematically to implement online testing. By spring 2004 all Virginia high schools 
must be able to use online testing. Several SREB states — including Delaware and Kentucky — 
are conducting pilot tests to study the potential of online testing. Texas has one online assess- 
ment (algebra). Mississippi uses some online testing for students who need to make up exams. 
Maryland and North Carolina are using “computer-adaptive testing” that is designed to meet 
the unique needs of disabled students. 

Some states outside of the SREB region — including Idaho, Indiana and Oregon — are 
addressing online testing, and South Dakota recently stopped its exploration of online testing. 

In fall 2002 thousands of second- through lOth-graders in Idaho took the new standards-based 
state tests online. Idaho promotes this approach to provide “an assessment system that would 
provide data — first and foremost — to improve instruction, which, in turn, would improve 
accountability.” Indiana says online testing has shortened by 45 percent the turnaround time 
for receiving results. Indiana also is testing software that grades essays online. Oregon has pilot- 
tested online testing with more than 6,000 third- through 10th -graders. Oregon's online testing 



is unique because it “adapts” to the student’s responses: The difficulty of subsequent questions 
is based on whether the student answers a question correctly or incorrectly. This method helps 
teachers design instruction to meet students’ individual needs. South Dakota, until recently, 
was as a leader in online testing, but the state moved from a norm-referenced test (the Stanford 
Achievement Test) to a criterion-referenced test (the Dakota Test of Educational Progress) that 
is not available online. All students will use pencils and paper when they take the Dakota Test 
of Educational Progress this spring. The state expects to resume online testing eventually. 

A summary of SREB states’ actions related to online testing appears at the end of this report. 



What is Virginia’s experience with online testing? 



In 2000 Virginia began funding the Virginia Standards of Learning Technology Initiative, 
a large-scale project to help school divisions improve student achievement through the use of 
statewide, Web-based resources. The initiative, which is beginning with Virginia’s high schools, 
includes funding to achieve three goals: 

1 . provide one computer for every five students; 

2. make every school capable of using an Internet-ready local area network; and 

3. ensure high-speed, high-bandwidth capabilities for instructional, remedial and testing needs. 

Achieving these goals will mean that all high school seniors can take their Standards of 
Learning tests online by spring 2004. More information about this initiative is available online: 
http://l4l.104.22.210/VDOE/Technology/soltech/LegislativeDocs/iteml43.htm. 

By fall 2002 more than 30 school divisions had administered online Standards of Learning 
tests at one or more high schools. Overall, more than 15,000 tests in eight subject areas were 
taken online. In the 2002-2003 school year, 94 of the 132 divisions planned to administer online 
tests. The program still is in the test phase, but all aspects thus far have been successful. Depart- 
ment of Education staff, contractors and school personnel have worked together in implementing 
this program and addressing difficulties. 

Virginia officials say that the online testing program also will have the following benefits: 

0 improved Internet access for teachers; 

a greater ability to share instructional resources; 

II opportunities to integrate technology into instruction; and 

HI increased communication among colleagues. 

The Virginia Department of Education Web site (www.pen.kl2.va.us) provides many 
informative documents, including two important ones related to online testing: Web-based 
Standards of Learning Initiative: Project Plan (released September 2000) and the SOL 
Technology Initiative: Report on the Demonstration Phase Quly 2001). 
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Educational Technology Cooperative 





Online Testing Survey Results 








March 2003 




State 


Is your state engaged 
in online testing 
related to your 
accountability system? 


Briefly describe 
the scope and status 
of initiatives. 


Who can provide 
additional information 
about these initiatives? 


Alabama 


No. 


Alabama will pilot-test an online 
version of the Alabama Alternate 
Assessment this spring. Alabama also 
is pilot-testing DIBELS, an online 
reading assessment, in kindergarten 
through third grade. 


Gloria Turner, 

administrator of student assessment 
gturner@alsde.edu 


Arkansas 


No. 


Online testing is unlikely to be a 
priority in the near future. 


Charles Watson, 
coordinator. 

State Board/Special Projects, 
Arkansas Department of Education 
cwatson@arkedu.kl2.ar.us 


Delaware 


Yes. 


Delaware pilot-tested its online tests 
in eighth-grade reading, eighth-grade 
math and fifth-grade reading in 
November 2002. If the results are 
positive, Delaware will consider 
using online testing for retests 
during the summer. 


Wendy Roberts, 

director of assessment and analysis 
wroberts@doe.kl2.de.us 


Florida 


No. 


The state is exploring the use of 
online testing for Exceptional 
Student Education (ESE) accommo- 
dations to meet the needs of disabled 
students and for graduation tests. 


Cornelia Orr, 
program director. 

Assessment, Testing and Evaluation 
cornelia.orr@fldoe.org 


Georgia 


Georgia is exploring the 
use of Web-based testing 
to save money and improve 
the turnaround time for 
test results. 


Georgia is using its Web-based test- 
item bank (Criterion-Referenced 
Competency Test) for instruction. 
The CRCT is a part of the account- 
ability system, because results on 
state tests are used to measure 
student achievement. 


David Harmon, 
division director of research, 
evaluation and testing 
dharmon@doe.kl 2.ga.us 


Kentucky 


Kentucky is field-testing 
the use of online testing 
for some students with 
disabilities. 


Kentucky is testing a delivery system 
for a form of the Kentucky Core 
Content Test. This online version, 
which is being administered to 
students with disabilities, uses text 
readers in normal instructional 
activities to access instructional 
materials. If pilot-phase funding is 
secured, Kentucky may implement 
the program in spring 2003. 


C. Scott Trimble, 
associate commissioner, 
Office of Assessment and 
Accountability 
strimble@kde.state.ky.us 
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State 


Is your state engaged 
in online testing 
related to your 
accountability system? 


Briefly describe 
the scope and status 
of initiatives. 


Who can provide 
additional information 
about these initiatives? 


Louisiana 


No. 


None. 


Scott Norton, 

director. Division of Student 
Standards and Assessment 
snorton@doe.state.la.us 


Maryland 


The Maryland Account- 
ability System provides 
an online version of the 
Maryland Functional Tests, 
which students are required 
to pass in order to graduate. 


For several years the Maryland 
Department of Education has had 
computer-adaptive versions of the 
Maryland Functional Tests in read- 
ing and math. Until 2002-2003, 
these tests were taken by students 
at stand-alone computer stations. 
Beginning in the 2002-2003 school 
year, Maryland students can take 
an online form of the Maryland 
Functional Tests via a secure Internet 
connection. 


Martin Kehe, 
operational manager. 
Assessment Branch, Maryland 
Department of Education 
mkehe@msde.state. md .us 


Mississippi 


Mississippi has limited 
involvement with online 
testing. 


Mississippi allows online testing only 
when students must take makeup 
exams of high-stakes tests and need 
the results quickly in order to gra- 
duate on time. 


Kris Kaase, director, 
student assessment 
kkaase@mde.kl2.ms.us 


North 

Carolina 


North Carolina is working 
on the North Carolina 
Computerized Adaptive 
Testing System (NCCATS), 
an online version of a 
paper-and-pencil test. 


NCCATS has had some success but 
is not ready for full implementation. 
NCCATS was designed to give dis- 
abled students access to test items 
and scale score results. The system is 
not Internet-based. An initial study 
of online testing was insufficient in 
scope; a more inclusive study will be 
done in spring 2003. 


Mildred Bazemore, 
section chief for testing 
mbazemor@dpi.state.nc.us 


Oklahoma 


No. 


There are ongoing, informal discus- 
sions about online testing. 


Kay Ruelle, 

team leader. Student Research, 
Testing and Planning 
kay-ruelle@sde.state.ok.us 


South 

Carolina 


No. 


South Carolina is beginning to con- 
sider online testing for initiatives 
that are not part of the account- 
ability system. 


Teresa Siskind, 

director, Office of Assessment 
TSiskind@sde,state.sc.us 
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Educational Technology Cooperative 
Online Testing Survey Results (continued) 



State 


Is your state engaged 
in online testing 
related to your 
accountability system? 


March 2003 

Briefly describe 
the scope and status 
of initiatives. 


Who can provide 
additional information 
about these initiatives? 


Tennessee 


No. 


None. 


Benjamin Brown, 

executive director. Evaluation and 

Assessment 

Ben. Brown@state.tn.us 


Texas 


There is an online version 
of the end-of-course test in 
algebra. 


Texas is planning to offer additional 
assessments online. 


Ann Smisko, 

associate commissioner. 

Curriculum, Assessment and 

Technology 

asmisko@tea.state.tx.us 


Virginia 


Virginia is implementing 
the Standards of Learning 
(SOL) Technology Initiative. 


This Web-enabled initiative is 
intended to improve all high schools’ 
capabilities in Standards of Learning 
(SOL) instruction, remediation and 
testing. Legislation requires all high 
schools to be able to use online test- 
ing by 2004. 


Shelly Loving-Ryder, 
assistant superintendent for 
assessment and reporting 
sryder@mail.vak 1 2ed.edu 


West Virginia 


No. 


West Virginia is exploring issues 
related to online testing and is 
consulting with testing contractors. 


Jan Barth, 

executive director, Student Services 
and Assessment 



jbarth@access.kl 2.WV.US 
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